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Abstract 

Objectives: MicroRNA-21 in serum is a promising marker for the diagnosis of lung carcinoma. A meta-analysis was 
performed to assess the diagnostic accuracy and clinical value of serum microRNA-21 in patients with lung carcinoma. 

Methods: PubMed, EMBASE, Web of Knowledge (ISI), the Cochrane Library, Scopus, BioMed Central, Science Direct, China 
National Knowledge Infrastructure (CNKI), Wan Fang data and Technology of Chongqing (VIP) databases were searched to 
identify studies in English and Chinese that assessed the diagnostic value of serum miR-21 for lung carcinoma, from 
inception to 9 April 2014. Two independent investigators identified and extracted the study characteristics from all articles 
according to defined inclusion and exclusion criteria. Quality assessment of diagnostic accuracy studies (QUADAS) was used 
to score the quality of the eligible studies. Stata12 and Meta-DiSc software were used to test the heterogeneity and to 
perform the meta-analysis. 

Results:Our search returned 1008 articles, of which seven fulfilled the inclusion criteria, accounting for 500 patients and 386 
controls. Using random-effect model analysis, the summary assessments revealed that the mean sensitivity was 0.71% 
(95%CI: 57-82%) and specificity was 0.84% (95%CI: 76-89%). The area under the receiver operating characteristic curve was 
0.86 (95%CI: 0.83-0.89). In addition, heterogeneity was clearly apparent but was not caused by the threshold effect, as 
shown by Meta-DiSc analysis. 

Conclusion: The current evidence suggests that serum miR-21 can be rapidly measured in lung carcinoma patients and has 
potential diagnostic value with moderate sensitivity and specificity. Further prospective studies to assess the early stage 
diagnostic value are needed in the future. 
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Introduction 

Lung cancer is one of the most common malignancies 
worldwide. The American Cancer Society reported that there 
were 228,190 new lung and bronchus cancer cases and 159,480 
new deaths in 2013 [1]. Moreover, lung cancer has become the 
most common cancer in China. New statistical data, investigated 
by First Sino-US Tobacco Control Forum for Cancer institutions 
on 17 March 2013, showed that lung cancer mortality has 
increased by nearly 10-fold during the past 40 years, and that is 
has become the top cause of cancer-associated deaths, with a rate 
of 45.57 cases per 100,000 people. Especially in male patients, the 
mortality rate is as high as 61.00 cases per 100,000 individuals. 
However, the available treatment options remain insufficient. 
Comprehensive treatment based on surgery can significandy 
prolong survival in patients with stage I non-small cell lung cancer 
(NSCLC), and 5-year survival rates have improved to 45-65% [2]. 
Unfortunately, there is no ideal detection method for lung cancer 
diagnosis, especially for early stage lung patients when there are no 
obvious symptoms. At present, clinicians need to combine a 
variety of test results to determine whether a patient has lung 
cancer, and to distinguish the grade and/or stage of the disease. 



These methods currently include clinical manifestation, physical 
examination, imaging, endoscopy, among others. However, there 
is no method available that detects the disease with both high 
sensitivity and specificity. Thus, novel diagnostic technologies are 
urgently required. Tumor markers for lung cancer in the blood 
have become a major focus. Some biomarkers, as carcinoem- 
bryonic antigen (CEA), neuron specific enolase (NSE), cytokeratin 
fragment (CYFRA21-1), and tissue polypeptide specific antigen 
(TPS), have been used in the clinic, but also lack sufficient 
sensitivity and specificity. 

MicroRNAs (mirRNAs, miRNAs) are a large family of non- 
coding RNA of approximately 19-25 nucleotides. MiRNA genes 
first synthesize the primary transcripts (pri-miRNA) in the nucleus 
[3], then form precursor miRNA (pre-miRNA) after cleavage by 
Drosha, and are transported to the cytoplasm, where mature 
miRNA is produced following cleavage by Dicer [4,5]. Micro- 
RNAs play a pivotal regulatory role in gene expression after 
mature miRNA partially from complementary pairing with 3' 
untranslated region (3'UTR) of the the target mRNA [6]. 
MicroRNAs have been closely associated with the development 
of a variety of tumors, such as lung cancer [7] , gastric cancer [8] , 
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Figure 1. Flow diagram of the selected eligible studies based on the inclusion and exclusion criteria. 
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breast cancer [9], nasopharyngeal carcinoma [10], neuroblastoma 
[11], thyroid cancer [12], leukemia, liver cancer, and colorectal 
cancer [13,14]. Furthermore, tumor-associated microRNAs re- 
main stable in serum [15,16] and have been shown to be 
advantageous in the diagnosis of tumor diseases; in particular, they 
have drawn much attention in the field of lung cancer because of 
their differential expression characteristics. Quantitative real-time 
reverse transcription polymerase chain reaction (RT-qPCR) 
exhibits high sensitivity and throughput, good reproducibility 
and specificity of nucleic acid molecule detection, and can achieve 
rapid results. Therefore, it has become the gold standard for 
quantitative detection of serum miRNA in basic and clinical 
research [17,18]. 

MicroRNA-21 (miR-21) is a frequently studied microRNA in 
lung cancer, and is considered to have an important role in the 



progression of lung cancer. Wang et al. [19] reported that 
miRNA-21 in NSCLC patient serum was significantly higher 
than that in the healthy control group, and its high expression level 
was correlated with lymph node metastasis and lymph node 
staging. These data have also been reproduced in other studies 
[20,21], which showed that miRNA-21 can be used as a diagnosis 
biomarker for early stage NSCLC. Furthermore, Le et al. [22] 
found that postoperative serum miR-21 levels decreased signifi- 
cantly compared with that in preoperative serum concomitant 
with shorter survival in patients with lung carcinoma, which 
suggested that miR-21 can be used to predict the risk of lung 
cancer recurrence. Gao et al. [23] investigated miR-2 1 expression 
in patients with lung squamous cell carcinoma, and found high 
expression of miR-2 1 also indicated a poor prognosis. 
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Figure 2. Forest plots of sensitivities and specificities for miR-21 test accuracy in lung carcinoma. 
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To date, many researchers have published their data for the 

diagnostic value of miR-21 in lung cancer, and have raised 

concerns about the efficiency of miR-2 1 as a biomarker. In this 

study, we performed a meta-analysis of these published studies to 

5^ estimate the diagnostic value of miR-2 1 in lung cancer, 
"a 

e Methods 

cu 

£ Search strategy and selection criteria 

S We systematically searched PubMed, EMBASE, Web of 

° Knowledge (ISI), the Cochrane Library, Scopus, BioMed Central, 
Science Direct, China National Knowledge Infrastructure 

£ (CNKI), Wan Fang data and Technology of Chongqing (VIP) 

"§ database for studies that assessed the diagnostic value of miR-21 in 

4_, O 

"C, lung cancer. Existing systematic reviews, meta-analysis and 

5 bibliography of the reports were also checked for potentially 

u relevant additional studies. The studies were restricted to those in 

u English and Chinese only. 

g The following selection criteria were used to search articles and 

S abstracts: ('miR-21' or 'microrna-21' or 'Hsa-mir-21') and 'lung' 

■g and ('cancer' or 'carcinoma' or 'tumor' or 'neoplasm' or 'cancers'). 

£ Databases were searched between their inception and 9 April 

1 2014. 

"t Data extraction and quality assessment 

% Inclusion criteria were as follows: 1) Measurement of serum of 

® miR-2 1 in lung cancer. 2) The appropriate gold standard method 

h confirmed the case group and patients with lung cancer and that 

< the control group was disease-free. 3) Sensitivity and specificity 

< were reported to provide sufficient information to construct 2x2 

0 contingency tables. The table includes false and true positive and 
> negative information. Animal experiments, reviews, meta-analysis 
Si and conferences were excluded, as previously described [24] . 

Jj Two investigators independently extracted data in the study to 

B obtain information, which included study details such as first 

jS author, year of publication, disease type, methods and cut-off 

sj value, and data for a 2x2 table and study design. If further 

g, information was needed, the corresponding authors were contact- 

= ed. 

(U 

-J5 The Quality Assessment of Diagnostic Accuracy Studies 

2 (QUAD AS) was used to assess each study for the quality of the 

d information reported [25]. 
> 

a Statistical analysis 

OJ 

Statal2 and Meta-DiSc software were used to test the 

d; heterogeneity and to perform the meta-analysis [26]. We tabulated 

01 2x2 contingency tables, which contained information regarding 
S true positives, false negatives, false positives and true negatives, to 
a calculate pool sensitivity, pool specificity and a corresponding CI. 
E The Spearman model was applied to assess heterogeneity caused 
6. by different cut-off values. Forest plots, Cochran-Q value and I 2 
c test were adopted to estimate heterogeneity caused by others 
| 5 factors. We also introduced funnel plots, Egger's test and Begg's 

test to investigate publication bias. P-values of <0.50 indicated 
significant heterogeneity [27,28]. 
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Results 

Data extraction 

A total of 1008 articles were retrieved from the databases. After 
reviewing the titles and abstracts, 980 articles were excluded, 
including 179 reviews and meta-analysis, 131 meetings and others, 
o ]5 and three no-blood samples. After reviewing the full text according 

to the selection criteria, 21 articles further excluded, seven of 
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Figure 3. Summary ROC curve of miR-21 diagnostic value in lung carcinoma. 

doi:1 0.1 371 /journal.pone.0097460.g003 



which contained imperfect information needed to meet the 
requirements of the inclusion criteria. Three articles published 
were by the same author in 2011 [29-31], hence we selected the 
article that examined the most samples [30]. Finally, seven articles 
[22,30,32-36] containing 868 samples remained (Figure 1). Since 
some did not have cut-off values, we contacted the corresponding 
author to ask for the information, and all replied. 

Data characteristics and quality assessment 

Table 1 shows the eligible characteristics of articles that were 
published between 2011 and 2013. All 500 lung cancer patients 
were confirmed by histology, which is the gold standard for lung 
cancer diagnosis. Lung cancer stages were classified according to 
the National Comprehensive Cancer Network (NCCN) or the 
Union for International Cancer Control (UICC) in 2010 and/or 
American Joint Committee on Cancer (AJCC, 7th edition) in 
2009. A total of 368 normal volunteers showed no characteristics 
of lung cancer during their medical checkup, including 92 healthy 
smokers and 30 benign pulmonary nodules [33]. RT-qPCR was 
used to detect miR-21 expression in human peripheral blood. 
Most data were normalized using the 2-AACt method, with the 
exception of that produced by Amal A. et al., which was 
normalized using the ACt method [35]. The cut-off values or 
expression levels are presented in Table 1. 



In addition, Han-Bo Le et al. [22], Hui Zhang et al. [36] and 
Juan Wei et al. [29] compared miR-21 expression in the sera of 
237 patients with early stage disease (I and II) against healthy 
individuals. Dongfang Tang et al. [33] set a training group and 
validation group independently. Thus, we calculated 62 patients in 
the training set and 34 malignant tumor patients in the validated 
set by their respective given information as patients cases of this 
study, while 60 healthy smokers of the training set, 32 healthy 
smokers and 30 patients with benign pulmonary nodules of the 
validated set were calculated as control cases. Strikingly, the 
training group and validation group had the same cut-off value, 
but did not have a pool AUC value when combined. Moreover, 
Han-Bo Le et al. [22] and Hui Zhang et al. [36] investigated the 
different levels between pre- and post-operative lung cancer 
patients, totaling 102 cases. QUAD AS scores of studies were from 
1 2 to 13, which satisfy the majority of the standards, as no one 
reported the interval period between the reference standard and 
index test to ensure that the target conditions did not change 
during the two tests. Yanzhao Li et al. [32] did not described 
sufficient details of histology method used to enable its replication. 

Heterogeneity analysis and diagnostic value of miR-21 

As shown by the forest plot of sensitivity and specificity 
(Figure. 2) for miR-2 1 testing in lung carcinoma, the heterogeneity 



Table 2. RDOR and P-values of covariants in the meta-regression analysis. 
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Note: RDOR: relative diagnostic odds ratio. 
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causes of heterogeneity. As shown in Table 2, the data suggest that 
the ethnic background of patient samples did not cause 
heterogeneity, nor did the normalizers, RNA extraction kits, or 
RT-qPCR measurements. 

Thus, the random effects model approach was used in this 
meta-analysis to eliminate heterogeneity [37]. As a result, the 
summary assessment of miR-21 in the diagnosis of lung carcinoma 
showed that the pooled sensitivity was 0.71 (95%CI 0.57-0.82) 
and the pooled specificity was 0.84 (95%CI 0.76-0.89). The area 
under the summary receiver operating characteristic curve was 
0.86 (95%CI 0.83-0.89; Figure. 3). These data indicated that the 
diagnostic capability of miR-21 in lung cancer is moderate. 
Likewise, both the likelihood ratios and post-test probabilities were 
moderate (Figure. 4). The positive likelihood ratio of 4 implies that 
a person with lung cancer is four-times more likely to have a 
positive test result than a healthy person. Given a pre-test 
probability of 20%, the post-test probability of lung cancer for a 
positive test result is 52%, while a negative test result is 8%. 
Meanwhile, the diagnostic odds ratio value was 12.58 (95%CI: 
5.76-27.48), indicating miR-21 can be used as a good indicator of 
lung carcinoma diagnosis (Figure. 5). 

Publication bias 

Funnel plots were calculated to access the publication bias of the 
studies (Fig. SI). The shape of funnel plots revealed symmetry 
despite the limited study number. Egger's and Begg's tests were 
also used to additionally highlight the publication bias by 
quantitative methods in the meta-analysis. P values of the Egger's 
and Begg's tests were 0.058 and 0.548, respectively, which 
suggested no publication bias for the meta-analysis in the use of 
miR-21 in lung carcinoma diagnosis in a limited number of 
eligible studies. 



Figure 4. Fagan's Nomogram for assessment of post-test 
probabilities (PTPs). 

doi:1 0.1 371 /journal.pone.0097460.g004 

analysis revealed I 2 values of 90.54 (95% CI 85.04-96.04; 
P= 0.000) for sensitivity and 74.30(95%CI 54.84-93.76; 
P— 0.000) for specificity. This provided evidences of high levels 
of heterogeneity in the seven studies [27]. However, the Spearman 
value was found to be 0.14 (P=0.76), It implying that the 
heterogeneity was not caused by the threshold effect. Meta- 
regression analysis was used to identify if the heterogeneity was 
caused by ethnic background and/ or the miRNA normalizer and/ 
or different methods of RT-qPCR, which are the most important 



Discussion 

MiR-2 1 as a novel biomarker of diagnosis in lung cancer has 
generated much interest. The differential diagnostic value of miR- 
21 for lung cancer patients has been observed with inconsistent 
conclusions. However, no meta-analysis has previously been 
reported. Following the acquisition of a large sample size and 
appropriate method to synthesis the individual data, a meta- 
analysis to assess the role of miR-21 in the diagnosis of lung cancer 
was performed. 

Seven studies were included in this meta-analysis. They satisfied 
all QUAD AS requirements except the fourth, which did not show 
the interval period between reference standard and index test. 
Samples of peripheral blood derived during the patients' initial 
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Figure 5. Diagnostic Odds Ratio with Cochran-Q value. 
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assessments were confirmed as lung cancer before definitive 
adjuvant therapy and/or surgical intervention. However, it was 
unknown whether the index test was taken in time. Heterogeneity 
is another major problem in interpreting the results of a meta- 
analysis. The threshold effect must be considered as the first factor 
in testing the accuracy of a study; we used Spearman and 
Cochran-Q test, and found Spearman value of 0.00 (P— 1.00) 
using Meta-Disc analysis, as there was zero value existing in the FP 
of Yanzhao Li et al. [32] study. We changed 0 to 1, the minimum 
value of this research, which corrected the Spearman value to 0.14 
(P = 0.76). This implied that the heterogeneity was not caused by 
the threshold effect. The Cochran-Q, value was 32.65 (P=0.00), 
which is the same result as the Spearman value. One-way 
sensitivity analysis (data not shown) was implemented to identify 
the factors that caused heterogeneity, but it failed. Thus, a 
random-effects model was used to eliminate some heterogeneity. 
In addition, there are other limitations in this meta-analysis. Some 
data, such as conference abstracts, non-English and Chinese 
literature, unpublished data and other inconsistent reports 
according to our selection criteria were excluded. All may cause 
publication bias to some degree, although there is no publication 
bias for the funnel plots and Egger's and Begg's tests. In summary, 
our data imply a moderate value of miR-2 1 in lung carcinoma 
diagnosis [27,39]. 

Moreover, the lung cancer analyzed in the meta-analysis was 
general, and included squamous cell carcinomas (SCC) and 
adenocarcinomas amongst other types. MiR-2 1 expression level in 
plasma varies with the developmental stage of the disease, and 
there is insufficient data to analyze each stage of each lung cancer 
by meta-analysis. Han-Bo Le et al. [22] and Hui Zhang et al. [36] 
both compared the plasma miR-2 1 expression between pre- and 
post-operative patients with lung carcinoma, and between early 
stage lung carcinoma patients (stage I II) and healthy volunteers. 
They obtained comparable results that showed the following: 1). 
the expression level of miR-2 1 was more significandy decreased in 
post-operative plasma than in paired pre-operative sample; 2). the 
expression level of miR-2 1 was more increased in lung carcinoma 
plasma samples than healthy volunteers. The sensitivity and 
specificity of miR-2 1 in lung carcinoma diagnosis reported by 
Han-Bo Le et al. [22] were 47.5% and 88%, respectively, while 
those reported by Hui Zhang et al. [36] were 77.5% and 85.5%, 
respectively. Interestingly, Juan Wei et al. [29] also completed 
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similar research and reported that miR-2 1 expression in plasma 
was higher in stage III-IV patients than in stage I II patients and 
higher in SD and PD patients than in PR patients, who, with 
advanced NSCLC, were treated with platinum chemotherapy. In 
summary, these results suggest that miR-2 1 may serve as a 
potential novel non-invasive biomarker for the diagnosis of lung 
cancer and in the development of lung cancer treatment. 
Unfortunately, we fail to obtain a 2x2 table or sensitivity and 
specificity value from Juan Wei et al. [29], thus there were 
insufficient articles to perform a meta-analysis. Therefore, 
additional reports of early stage diagnosis and prognosis are 
needed. 

In conclusion, miR-2 1 is a promising biomarker for the 
diagnosis of lung carcinoma. Its sensitivity and specificity are both 
higher than that of single traditional diagnostic markers, such as 
CEA, NSE, CYFRA-21 and TPS [38]. It can also be assessed 
more rapidly and less invasively than other markers that require 
analysis by histopathology. As no ideal biomarker currently exists 
for lung carcinoma miR-2 1 can be used as a preferred diagnostic 
biomarker. 
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